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23 Responsive to communication(s) filed on Oct 14. 1999 



□ This action is FINAL. 

□ Since this application is in condition for allowance except for formal matters, prosecution as to the merits is closed 
in accordance with the practice under Ex parte Qu9>V§35 CD. 11; 453 O.G. 213. 

A shortened statutory period for response to this action is set to expire 3 month(s), or thirty days, whichever is 

longer, from the mailing date of this communication. Failure to respond within the period for response will cause the 
application to become abandoned. (35 U.S.C. § 133). Extensions of time may be obtained under the provisions of 
37 CFR 1.136(a). 



Disposition of Claim 

K Ciaim(s) 13-25 



is/are pending in the applicat 



Of the above, claim(s) 
□ Claim(s) 



is/are withdrawn from consideration 
is/are allowed. 



K] Claim(s) 13-25 



□ Claim(s) 

□ Claims _ 



is/are rejected, 
is/are objected to. 



are subject to restriction or election requirement. 



Application Papers 

□ See the attached Notice of Draftsperson's Patent Drawing Review, PTO-948. 

□ The drawing(s) filed on is/are objected to by the Examiner. 

□ The proposed drawing correction, filed on is □ approved disapproved. 

□ The specification is objected to by the Examiner. 

□ The oath or declaration is objected to by the Examiner. 

Priority under 35 U.S.C. § 119 

□ Acknowledgement is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d). 

□ All □Borne* [N]one of the CERTIFIED copies of the priority documents have been 

□ received. 

□ received in Application No. (Series Code/Serial Number) . 

□ received in this national stage application from the International Bureau (PCT Rule 17.2(a)). 
*Certified copies not received: 



□ Acknowledgement is made of a claim for domestic priority under 35 U.S.C. § 119(e). 
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H Notice of References Cited, PTO-892 

□ Information Disclosure Statement(s), PTO-1449, Paper No(s). 

□ Interview Summary, PTO-413 

□ Notice of Draftsperson's Patent Drawing Review, PTO-948 

□ Notice of Informal Patent Application, PTO-152 
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DETAILED ACTION 



Drawings 



1 . The corrected or substitute drawings were received on 10/14/99. These 
drawings are approved by the examiner. 



2. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for 
all obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as 
set forth in section 102 of this title, if the differences between the subject matter sought to be 
patented and the prior art are such that the subject matter as a whole would have been obvious 
at the time the invention was made to a person having ordinary skill in the art to which said 
subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 



3. Claims 13 -25 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Holm et al. f (5,850,629) and in view of Waters et al., (5,657,426). 

As per claims 13 and 14, Holm et al., teach user interface controller for 
text-to-speech synthesizer for interlocking with multimedia comprising the steps 
of: 



Claim Rejections - 35 USC §103 
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a multimedia information input unit for organizing text, prosody information 
etc., including gender and speech rate (abstract, fig. 1 , Figure 3, (cybertalk 
preferences and user dictionary test2), figures 5 and 6, Col. 6, lines 52-59, Col. 15, 
line 29 - Col. 16, line 39); 

a data distributor by each media for each media for distributing the 
information of said multimedia information input unit (fig. 10); 

a language processor for converting the text distributed by said media 
distributor by each media into a phoneme stream, presuming prosody information 
and symbolizing the presumed prosody information (Col.11, line 43 - Col. 13, line 
7); 

a prosody processor for calculating a prosody control parameter value 
(Col. 5, lines 58-67); 

a synchronization adjustor for adjusting a duration o each phoneme using 
the synchronization information (Fig. 4, item 80); 

a synthesis unit database for receiving the individual property information 
from said data distributor, selecting synthesis units adaptable to gender and age, 
and outputting data required for synthesis (Fig 4, item 84, Fig 8, Col. 6, lines 52- 
59); 

a signal processor for producing a synthesized speech using the prosody 
control parameter (abstract). 
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Holm et al., teach organizing input data of a text-to-speech conversion 
system for interlocking with multimedia using prosody analysis, but they do not 
specifically teach synchronizing this information with moving picture and picture 
information. Waters et al., however does teach a text-to-speech system for coding 
and decoding moving pictures based on the result of speech analysis for 
interlocking with multimedia (Figures 2 and 3, Col.1, line 54- Col. 2, line 33). It 
would have been obvious to one with ordinary skill in the art at the time of 
invention to incorporate the capabilities of coding and decoding moving picture 
based on the result of text-to-speech analysis as taught by Waters et al., into the 
system of Holm et al., because this would enable a user to efficiently coordinate 
the moving pictures and speech resulting from the prosodic analysis, thereby 
creating a composite which is high in quality. 

As per claims 15-18, 22, and 24-25, Holm et al., teach analyzing and 
outputting prosody information (Col. 1 1 , line 43 - Col. 1 3, line 7, Fig. 1 , Col. 4, lines 
50-65, Fig. 7). 

As per claims 19-21 and 23, Waters et al.,, teach a system and method for 
a text-to-speech conversion system for interlocking with multimedia, using lip- 
shape, location information and duration information as per claims 19-21 and 23 
(Figures 1A and 1 B, 4, Col. 3, lines 52 - Col. 4, lines 32, Col. 5, lines 29- 45). 
Therefore, it would have been obvious to one with ordinary skill in the art at the 
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time of invention, that by synchronizing speech and lip movement as taught by 
Waters et al., and incorporating it into the system taught by Holm et al. # an 
artisan with ordinary skill in the art can effectively combine the capabilities 
afforded by multimedia and be able to view the results with a greater degree of 
accuracy. 



4. Applicant's arguments with respect to claims 13-25, have been considered 
but are moot in view of the new ground(s) of rejection. 



5. Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to Vijay Chawan whose telephone number is 
(703) 305-3836. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David R. Hudspeth, can be reached at (703) 308-4825. 



Response to Arguments 



Conclusion 
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Any response to this action should be mailed to: 

Commissioner of Patents and Trademarks 
Washington, D.C. 20231 

or faxed to: 



(703) 308-9051, (for formal communications intended for entry) 



(703) 305-9508 (for informal or draft communications, please label 
"PROPOSED" or "DRAFT") 



Hand-delivered responses should be brought to Crystal Park II, 2121 
Crystal Drive, Arlington. VA., Sixth Floor (Receptionist). 
Any inquiry of a general nature or relating to the status of this application should 
be directed to the Group Receptionist whose telephone number is (703)305-3900. 

Vijay Chawan 
November 2, 1999 



Or: 




DAVID R. HUDSPETH 
SUPERVISORY PATENT EXAMINER 
GROUP 2700 



